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(57) Abstract 

Method and apparatus for controlled copying of an audio or video signal transmitted over a cable television or direct satellite broadcast 
system or the internet. Copyrighted (or other) audio or video material is protected from unwanted copying (recording) by the combination 
of a watermark embedded in the audio or video signal at the head end together with additional copy protection data inserted in the audio 
or video signal, either a ticket or a second watermark. Video line (21) in the vertical blanking interval for (NTSC TV) is used to hold the 
ticket (cryptographic counter). An audio or video watermark is embedded in the active portion of the audio or video signal. Only if the 
consumer is willing to pay a fee is the video signal with both the watermark and the ticket transmitted to his recording device which then 
matches the watermark to a mathematical function of the ticket, and only if they match is recording permitted. Alternatively, this consumer 
control may operate on a second watermark in the audio or video. The corresponding playback device outputs an audio or video signal 
which does not have the ticket and hence no further copying is permitted. This enables a single copy to be made upon payment 
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WO 00/51348 PCT/US00/04835 

METHOD AND APPARATUS FOR ENHANCED AUDIO/VIDEO SERVICES WITH 
WATERMARKS AND ASSOCIATED DATA 



FIELD OF INVENTION 

This disclosure relates to audio and video and to enhanced 
audio and video services, such as pay-to-record or pay-to-tape, 
in, e.g., a cable television system, direct broadcast satellite 
system, or public computer network (internet) . 

DESCRIPTION OF THE PRIOR ART 

Some methods of controlling copying, or preventing serial 
copying, of video material with a video watermark rely on the 
recording device to add a second watermark to the video image. 
Watermarks are well known in the digital video field. 
Watermarks are signals embedded in an otherwise conventional 
video or audio signal that provide a unique identifier and thus 
discourage or prevent unauthorized copying or use. The 
watermark is not apparent to a person viewing the watermarked 
signal, but is readily detected by appropriate circuitry. 

Preventing or controlling copying is useful to prevent 
copyright infringement, and prevent distribution of 
unauthorized copies. In a "generational" control system where 
there is a one -copy- allowed state and a no-more-copies-allowed 
state, the combination of first and second watermarks define 
the no-more-copies -allowed state while the original watermark 
defines the one -copy -allowed state. (Copying here refers to 
use of a video tape recorder or video disc recorder, for 
instance.) In a television system with a digital cable 
television or direct broadcast satellite set top box (STB) , 
this type of system prevents serial copying of video content, 
since the compliant recorder makes the appropriate state change 
from one -copy- allow to no-more -copies during the record 
process. However, it does not easily allow for a pay-to-record 
feature since records are generally not provided with back 
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* , — 

channel and communication mechanisms for reporting purchase 

choices to an accounting system. 

To implement a pay-to-record feature, the STB needs to 

control the state change rather than the recorder controlling 

5 the state change. The pay-to-record feature thus allows a STB 

to output video under conditional access control with three 

possible payments by the viewer: No payment: the consumer 

(viewer) is not allowed to view or record the content; One 

level of payment: the consumer is allowed to view the content, 

10 but is not allowed to record it. Different (higher) payment: 
the consumer can both view and record the content. While it is 
possible to use the STB to introduce the second watermark, 
there are "legacy" issues that prevent widespread adoption of 
such a system. Specifically, there is a large installed base 

15 of STBs which do not incorporate the required features to allow 
this second watermark to be added. If a copy control system 
were introduced which used such a second watermark for copy 
control in STBs, then the existing consumers with STBs without 
this feature would be disenfranchised; those consumers would be 

20 unable to make copies at all. 

An alternative method of providing these copy control 
features uses a "ticket. 7 ' A ticket here is a cryptographic 
counter (number, usually in binary form) which is carried in a 
communications channel associated with the video. This ticket 

25 uses one-way cryptographic features to maintain a play and 
record history. One way functions are well known to those 
versed in the cryptographic field and include a class of 
transforms with the property that the function is relatively 
easy to compute but significantly harder to undo or reverse. 

30 In other words, given x it is easy to calculate f(x), however 
given f (x) it is difficult to compute x. 

A recorder detecting the one-copy-allowed state's 
watermark must then detect the correct ticket prior to allowing 
a recording to be made. To convey the ticket from the STB to 

35 the recorder, the vertical blanking interval (VBI) of the video 
signal can be used as a communications channel. However, this 
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has the disadvantage that some broadcast MPEG encoders (video 
compression devices) do not transmit the entire VBI . 
Alternatively, the ticket is inserted in the active picture 
area, such that it is in the overscan area of older TV's. 
5 However, this has the disadvantage that this data may be seen 
by the viewer on newer TV's (having less overscan) and thus may 
be deemed objectionable by the consumer. 

Yet another method of conveying the ticket is to activate 
and de-activate a subset of the analog anti -copying protection 

10 system signals to convey a bitstream. (Analog anti-copying 
protection signals here refer, e.g., to the Macrovision Corp. 
video copy protection processes which are commercially 
available; also see, e.g., Ryan U.S. Patent 4,601,603). This 
has the advantage that existing digital recorders such as those 

15 of the DVCAM type automatically delete this form of a ticket, 
since they fail to record the VBI. However, to accomplish the 
appropriate control out of the STB requires changes to the 
STB's internal software'. In some cases, this software can be 
downloaded to existing STBs over the air or cable. In this 

20 manner the encoder IC (integrated circuit) which generates the 
Macrovision Corp. analog copy protection pulses can react 
appropriately. However, in other cases the internal software 
has been installed permanently in the STB and cannot be 
modified. 

25 All these methods of transmitting a ticket require 

modification to the cable-TV/satellite system head end control 
software to provide a way to introduce the ticket into the 
video. This modification could undesirably be quite expensive 
to the cable-TV or satellite system operator. 

30 

SUMMARY 

This disclosure is directed to use of a watermark together 
with consumer controllable information in a television (or 
audio only) STB to provide pay-to-tape (or pay-to-record 
35 generally) control. One embodiment uses the existing video 
line 21 (in NTSC-TV) extended data service or closed caption 
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protocol to hold a ticket (cryptographic value) , and a video 
watermark, to jointly control copying of video being provided 
by a STB. This may be done in such a manner to enable 
additional features, such as pay- to- tape or pay-to-record, even 
5 in systems with prior art (legacy) STBs. In addition, this 
approach has the advantage that existing cable -TV or satellite 
system head end MPEG (compression) encoders can already 
transmit this type of information. Hence minimum changes are 
required to the system operator's infrastructure, 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1A shows a block diagram of a system in accordance 
with the disclosure; Figure IB shows detail of Figure 1A; 
Figure 1C shows a variant of Figure 1A; Figure ID shows a 
15 variant of Figure 1C. 

Figure 2 shows playback in accordance with this 
disclosure . 

Figure 3 shows a video recorder for the Figure 1A system. 
Figure 4 shows a block diagram of another system. 
20 Figure 5 shows a video recorder for the Figure 4 system. 

Figure 6A shows the system of Figure 1; Figure 6B shows a 
combination STB and recorder. 

Figure 7 shows the system of Figure 4 modified for audio. 
Figure 8 shows an audio recorder for the Figure 7 system. 

25 

DETAILED DESCRIPTION 

This disclosure is of a system which in one embodiment 
utilizes the existing infrastructure and legal advantage given 
to video line 21 (in the VBI in NTSC-TV) data and combines it 

30 with a new aspect available with video watermarks to generate 
revenue by allowing controlled copying of video signals. Video 
line 21 (in NTSC TV, which is the U.S. television standard) 
currently is used to carry closed caption data and parental 
blocking (V-chip) data in accordance with two significant 

35 standards: ANSI/EIA-608 and ANSI/EIA-744 . (Other television 

standards have similar features and may be used similarly.) In 

-4- 
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particular, various U.S. laws require television sets sold in . 
the U.S. to react to data carried by line .21 and require the 
data on line 21 to be preserved during transmission through 
various paths. In addition, U.S. FCC rules derived from the 
U.S. Telecommunications Act of 1996 also require TV receivers 
or PC's (personal computers) with video tuner cards, and with 
displays greater then 13" in size, to provide parental blocking 
(V-Chip control) . 

The legal requirement (in the U.S., at least) to provide 
parental blocking ensures that PC's (personal computers), as a 
potential class of storage/recording device, must recognize 
video line 21 data. Without this legal requirement, PC's might 
make that bandwidth/capacity available for other functions. As 
described in EIA-608, field 1, line 21 is allowed only to have 
closed captioning or the original picture content. (TV 
pictures have two fields per frame.) No other data services 
are allowed here. Field 2, line 21 may however have closed 
captioning, parental blocking or other extended data services. 
The protocol provided with extended data services is flexible 
enough that the protocol can accommodate a ticket (or other 
associated data) as described above. 

To follow the path of the ticket as shown in Figure 1A, at 
the time of content (program) preparation by the content 
provider 10, a seed (number) S is generated by a seed generator 
12. (This is, e.g., a random number generator.) This seed S 
is then subject to a fixed and secure one-way hash function F 
by hash function element 16. This is a one-way hash 
(compression) function of the type well known in the 
cryptographic field to determine the original ticket T. The 
system operator cannot reliably be known to be a trusted party; 
as such, making the seed accessible to him has the potential to 
weaken the system security. Hence in this embodiment the 
content provider, not the system operator, does this. In 
addition, the seed S is provided to the watermark embedder 20. 

Note that this is a hybrid digital -analog TV system. 
Upstream of the STB 34, the signal is digital; the STB outputs 
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an analog signal or optionally both a digital and analog form 

of the video signal. Signal transmission over other channels 

(e.g., the internet) is an alternative. 

Each block in the figures represents a conventional 

5 integrated circuit or commercially available component (circuit 

or software) or product or such a conventional element modified 

as disclosed here; the nature of the connections therebetween 

as shown in the figures, and any necessary modification 

thereto, will be apparent to one skilled in the art in light of 

10 this disclosure. For instance, the content provider block 10 
could be embodied in a suitably modified computer, with the 
seed, ticket and watermark generation carried out by software 
executed by the computer's central processing unit. 

The watermark embedder 20 submits the seed S recursively 

15 to the function F three times, as shown in detail in Figure IB, 
to generate a watermark W which is then conventionally added to 
(embedded in) the video signal V applied at video input port 
24. As shown in Figure IB, watermark embedder 20 includes the 
three one way hash function F blocks 22a, 22b, 22c and element 

20 23, which inserts the resulting data F[F(F(S))] as the 

watermark in the video. The output signal of embedder 23 is on 
line 27, also shown in Figure 1A. The watermark is added in a 
linear or non- linear fashion using any available watermarking 
technique. In some cases, to convey a sufficient number of 

25 bits to guarantee a ticket of appropriate, cryptographic 

complexity, the ticket is transmitted as a series of characters 
varying over time. These digital communication methods for 
conveying m-bytes of data across an n-bit wide interface are 
well understood, and can use any available protocol, including, 

30 for instance, TCP/IP or PPP. 

The video signal with the watermark V+W and the ticket T 
can be independently transmitted to the system (cable or 
satellite TV) operator/head end 30, or optionally the content 
provider can use a standard closed captioning encoder to embed 

35 the ticket T on, e.g., video line 21. (The distinction here 
between the content provider and system operator is arbitrary 
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and only for purposes of illustration.) An example of a method 

of independent transmitting the ticket T to the system operator 

would be to provide it on a floppy disk. The system operator 

could then send it through the system as MPEG user data. 

5 The line 21 method of distributing the ticket, as seen in 

Figure 1C, has the advantage that it allows the system operator 

to deploy the watermark/ticket addition system at its head end 

30 with no changes to the remainder of its existing 

infrastructure. (Figure 1C is otherwise identical to Figure 

JLO 1A.) In this second case, the (ticket T) data on line 21 of 

the video is extracted from the video signal and sent as MPEG 

data by the system's MPEG encoder. Without this, line 21 would 

be treated like video and would potentially be subject to the 

usual video compression artifacts, as transforms like the 

15 discrete cosine transform are applied, quantizations are made 

and bit rate reduction occurs. This undesirably would corrupt 

the ticket. 

In Figure 1C, from the system operator's head end 30, the 
ticket T is conveyed as line 21 MPEG data in the MPEG stream's 

20 video elementary stream while the video with watermark V+W is 
sent as compressed picture data. The ticket T is provided to 
all STBs 34 via conventional broadcast and reception of the 
MPEG data stream. 

Two classes of STBs 34 must be considered: legacy (old) 

25 STBs and new (upgraded) STBs. Legacy STBs are unable to have 
their internal microcontroller software upgraded. Thus they 
treat the ticket T on line 21 as standard closed caption, 
teletext or extended data. All of this information which is 
provided to the STB is output in the analog video signal as 

30 line 21 data. 

Consumers with legacy STBs are not inconvenienced or 
prevented from making a recording. This is a disadvantage from 
the content provider's standpoint, since he may in fact accrue 
less revenue as a result. However, television industry 

35 practice with respect to time shifting (video recording) may 

indicate that such consumers should not be disadvantaged. Thus 



WO 00/51348 PCT/US00/04835 

the system as described here ensures that the consumer is in 
fact not disadvantaged and that legacy STBs provide the ticket 
on their video output. As shown in Figures 1A, 1C and ID, the 
STB 34 outputs the video with the watermark with the ticket, 
5 V+W+T. In the case of Figure ID, the ticket T is not 

controllable by the consumer due to the "legacy" design of the 
STB 34a. Here the only possible user control is pay-and-view 
or not-pay-and-not-view. This is controlled by the switch 41 
shown in the STB 34a of Figure ID. 

10 New or upgraded STBs in accordance with this disclosure 

provide additional control to the consumer and also allow 
accrual of greater revenue for the system operator and lot 
content provider. In this case, the consumer can select 
whether he wishes to simply view the program or whether he 

15 wishes to view and record/store it. When he makes his 

selection through a standard interface with an onscreen display 
and remote control, the STBs conditional access (CA) sub- system 
36 stores an indicator of the activity - view only or view and 
record - which the consumer selected. 

20 This indicator is transmitted to the system operator via a 

conventional cable/satellite TV/ internet return path 3 9 
(Figures 1A, 1C) which includes, e.g., a telephone modem using 
the telephone lines or, in those cable TV systems which support 
it, a conventional cable plant return path. Return path 39 

25 allows the system operator to charge the consumer for his 

selection. A report of the access is made to the conventional 
system operator accounting system 3 5 for consumer billing 
purposes, via return path 39. 

After the conditional access sub- system 3 6 has stored the 

30 indication of the consumer's request, then the addition of the 
ticket T to the video occurs. If the content is only to be 
viewed, then the video is provided out of the STB 34 without 
the ticket: V+W, If the content is to be viewed and recorded, 
then the video is provided out of the STB 34 with the ticket: 

35 V+W+T. Adding the ticket T to the video V consists now of 
either introducing the ticket data T in the encoder IC 
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(integrated circuit) in the STB 34 or alternatively in an ATSC - 
RF remodulator integrated circuit located in STB 34. It is 
this encoder IC which outputs an analog video signal to the 
associated TV receiver (not shown) connected to STB 34 based on 
5 the input digital video signal. It is the RF remodulator which 
outputs an ATSC digital TV signal. In this case, the ticket T 
is controllable by the consumer via his STB 34. 

In Figures 1A and IC the recorder 42 now receives the 
analog video signal V+W or V+W+T. Video recorder 42 (portions 

10 of which are shown in detail in Figure 3) is mostly 

conventional but adapted as disclosed here to include the 
record control function 43. Ticket/line 21 data extractor 48 
extracts the ticket T and submits it to circuitry (processor) 
54, 56 which performs the one-way hash function F two times on 

15 ticket T. If the result of this hashing at 54, 56 matches, at 
comparator 57, the watermark W in the video signal detected by 
a watermark detector 50, then switch 58 is closed and recording 
by recorder 42 is allowed, i.e., recording is allowed when the 
following conditional logic statement is returned as being 

20 true: 



W-F( F [T] ) 



As shown, switch 58 (when closed) , controlled by 
25 comparator 57, couples the V+W signal extracted by the 

ticket/line 21 detector circuitry 52 to the output terminal of 
switch 58. This output signal V+W is then coupled to the 
actual recording part (not shown) of recorder 42, which is 
conventional. 

30 The pay-to-record feature has now been implemented. If 

there is no ticket T detected by the record control 43 recorder 
42, then this statement (comparison) is returned as no. This 
would be the case if the consumer had chosen to only view the 
content. If the wrong ticket T is accompanying the video, 

35 perhaps because a recording of the video signal has already 
been made, then again the statement is returned as false and 
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the recording is not permitted. (Note that recorder 42 need 
not be a digital recorder.) When recording the video and 
ticket to the recorder media 46 (in this case the media is a 
disc as shown in Figure 1A) , the ticket T is again subject to 
5 the function F to generate a new version of the ticket T' . In 
this case the cryptographic counter has been incremented: 
T' = F ( T ) . 

Later when playing back the video content from the 
recording media 46 as shown in Figure 2, circuitry associated 

10 with the drive 50 in the player 52 (e.g., a DVD player) again 
increments the ticket T by applying function F to it: T" = F( 
T' ). The drive 50 performs this function, e.g., when a DVD 
player 52 is implemented as a drive in a personal computer with 
a software or hardware associated MPEG decoder. (Note that 

15 there is no requirement for a drive and rotating media; the 
media may be, e.g., semiconductor storage with appropriate 
access circuit circuitry.) In any case, there is 
conventionally an interface (the drive or semiconductor storage 
control circuitry) to the actual recording (storage) medium. 

20 Then the drive (or appropriate circuitry) performs the 

ticket incrementing to enhance security. (The player 52 may be 
the recorder 42 of Figure 1A or a play only device.) Now at 
the MPEG decoder 54 in the player 52, the watermark W is again 
detected and checked against the current ticket T' ' . If a 

25 match is found, then playing is allowed and play control is 
implemented. In this case, the following equation must hold: 

W= T" = F( T' ) = F (F(T) ) 

30 An additional option under play control (also shown in 

Figure 2) at this point is to apply to the video signal an 
analog video copy protection of the type available from 
Macrovision Corporation, such as automatic gain control and/or 
color stripe. This has the advantage that further VHS analog 

35 video copies are prevented (or at least are not usable) as well 
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as the additional digital copies which are worked upon by 
equipment with watermark detectors. 

The watermark described herein can be implemented in a 
number of different ways, depending on the capability of the 
5 associated watermarking system. For instance, if the 
watermarking system that is available is able to carry 
sufficient data on a single field, then a sufficiently large 
amount of data can be carried such that no time varying 
mechanisms need be applied. In some embodiments the 

10 watermarking system carries 8 -bits per frame; however only 4 
bits are available for hashing seed purposes since 4 bits were 
needed for other uses. For security reasons it is desirable to 
use a 64 -bit seed and 64 -bit tickets. Thus, these embodiments 
require a minimum of 16 frames with the actual number of frames 

15 dependent on the transport protocol employed based on the 
digital communication system design. Thus one embodiment 
requires typical communication protocols such as PPP which 
employ start and stop characteristics. Due to the nature of a 
video communication channel, it may be desirable to employ some 

20 form of forward error correction. Reed-Solomon encoding is one 
example of a forward error correction code that is commonly 
used for this purpose. 

Some embodiments also employ 16 -bits per field when 
carrying the ticket on line 21. Thus, both the ticket 

25 processing and watermark processing require buffers for storage 
such that decisions can be delayed and timed to occur when 
whole data values are available. Design of these types of 
buffers is apparent to those in the video and digital 
communications fields in light of this disclosure. 

30 While the above disclosure is of a method using line 21 of 

analog video to carry the ticket between the STB and recorder 
to enable pay-to-record features, any combination of a 
watermark and consumer controllable information in an STB could 
be used. This approach is also not limited to any particular 

35 TV standard. In particular, other video lines could be used to 
hold the ticket as long as they have the desired 
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characteristics of being transmitted to the STB in a manner 
such that they can be controlled by the consumer through the 
STB. 

In addition, if the video is being transmitted over a 
5 digital interface, such as IEEE-1394 ("Firewire") or an ATSC 
(high definition TV) 8-VSB signal, from the STB to a device 
(recorder) which has storage capability then the ticket can 
still be controlled in the STB, In this case, the transmission 
or lack of transmission of the correct ticket is accomplished 

10 and the watermark/ticket combination still defines the copy- 
state. In these situations, the ticket could be transmitted 
using the MPEG User_data descriptor. In some cases, it may be 
desirable to not transmit any ticket at all, but in other 
cases, it may be desirable to transmit an incorrect ticket. 

15 There are also other places in these video signals which 

could be used to transmit the ticket; however, the ticket is 
still controlled in the STB. The STB provides a way for 
ensuring that the content owner receives payment, whether that 
payment is for viewing only or for viewing and recording. 

20 Thus, it is the watermark and associated data under consumer 
control in the STB which are used in this method. 

Another embodiment (see Figure 4) uses a second watermark 
embedder located in the STB 34 as a watermark remarker 60. (No 
ticket is used here.) In this method of creating video and 

25 record or view only video, a second watermark W2 is used. 

(Figure 4 shows elements identical to those used in Figure 1A, 
or similar, and thereby having reference numbers similar to 
those of Figure 1A with the letter "a" appended.) 

In the Figure 4 system, when the consumer selection 61 is 

30 to view (but not record) , the analog video signal output from 
the STB 34a is No-More-Copy: V+W1+W2. When the consumer 
selection 61 is to view and record, the video signal output 
from the STB 34a is Copy-Once: V+Wl . Under these 
circumstances, the record control portion 64 of the associated 

35 recorder 42a operates as shown in detail in Figure 5. (The 
remainder of recorder 429 is conventional.) 
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A watermark Wl detector 66 first detects watermark Hi. If. 
no watermark Wl is found, then recording (copying) is allowed 
since it is assumed free -copying is available or the content 
has no copyright restrictions. If watermark Wl is detected at 
5 68, then the watermark W2 detector 72 detects watermark W2 . If 
W2 is not detected, then recording is allowed since this 
defines the one-copy-allowed state. The system " fails safe" in 
that recording is allowed. Note that W is typically some 
predetermined function of the active video. The fail safe 

10 provision is so that the user is not unnecessarily 

inconvenienced by false positive watermark detections. In 
general, watermarks are "woven into the fabric" of the video 
image. Removing them without degrading the base active video 
content is very difficult. 

15 If W2 is detected along with Wl at 72, then no recording 

is allowed since this defines the no-more copies state. This 
is accomplished by controlling switch 76, which in this case 
(yes from comparator 70) is set to be open. Otherwise 
(recording permitted) switch 76 is closed and video signal 

20 V+W1+W2 from W2 embedder 74 is output from switch 76 to be 

recorded by the remaining (not shown) conventional portions of 
recorder 42a. If the video signal input to the recorder 42a 
has Wl but no W2 and is recorded on the media 46a, then the 
watermark W2 is embedded in the video signal prior to recording 

25 on the media 46a. 

Also, it should be recognized that in Figure 5, while 
separate detectors 66, 72 are shown for Wl and W2, these may in 
fact be implemented in the same functional hardware (or 
software) element with internal reconfiguration as to allow 

30 differentiation of Wl and W2. This implementation is readily 
achieved by one skilled in the art. Playback of media using 
this embodiment is simpler but it provides a lower level of 
security since no checking or detection of the watermarks is 
required. Also, in many cases a compliant recorder will be 

35 coupled to the player and will thereby prevent subsequent 

copies from being generated. A system without this coupling 
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still has value since record control can still provide value 
even without the added value of play control. 

While the above described systems are disclosed in the 
context of separate devices for the set top box (STB) and the 
5 recorder, there is nothing to preclude the functionality of 
both these devices being integrated into a single apparatus. 
Figure 6A shows the system as described above using the same 
reference numbers, but also showing the compliant player 80, 
which outputs as shown when playing the media 46, the video 

10 with the watermark and the ticket (V+W+T") . 

Figure 6B shows a related system having the STB 34 
combined with the recorder 42 in a single apparatus 84. As 
shown, the output signal stream from the recorder/player 42 may 
be applied to a recorder 88 if W=F(F(T)) . Similarly, the media 

15 46 may be played on player 86 outputting the video stream as 
shown, which is the video with the watermark and ticket 
(V+W+T") or merely the video with the watermark (V+W) . 

It is apparent that the systems of Figures 6A and 6B may 
be used in the above -described system employing the above- 

20 described first watermark and second watermark method for 
controlling recording. 

While the above disclosure is directed to video, a similar 
approach using the first watermark and second watermark may be 
applied to controlling recording of audio. Hence Figure 7 

25 shows a system in many respects similar to that of Figure 4, 

however being adapted for providing enhanced audio distribution 
with the possibility of paying to record. The only structure 
labeled identically in Figure 7 to Figure 4 is the system 
operator headend 30. The other structures, although somewhat 

30 similar, have been redesignated to indicate that in this case 
they are adapted for audio purposes. 

Hence the content provider 90, which is the source of the 
audio material, generates copy control information CGMS which 
is applied to the input terminal of a watermark embedder 92, to 

35 the other terminal of which is applied ordinary audio input 
signal A. The resulting output audio with watermark A+Wl is 
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communicated, via conventional channels, to the system operator 
headend 30. From there, the audio signal A+W1 is sent over, 
for instance, the satellite or cable television distribution 
sytem to the STB 96. STB 96 includes a conditional access 
5 system 98 to which is applied a consumer selection on line 100. 
The STB 96 also includes a watermark remarker 102 which 
adds watermark W2 under control of conditional access system 
98. The watermark remarker 102 then outputs the watermarked 
audio stream in one of two forms. One form is the copy-once 
_10 and the other is copy-no-more. In other words, the two forms 
are A+Wl or A+W1+W2, the analog audio A with or without 
watermark W2 but always including watermark Wl . The associated 
compliant recorder 106 receives this analog audio signal, and 
under control of its record control 108, does not record if Wl 
15 and W2 are present and adds W2 to the audio if it is not 

present and recorder 106 is in the recording mode, thereby 
outputting audio stream A+W1+W2 to record on associated media 
112. 

Figure 8 shows a block diagram of recorder 106 with 

20 further detail, showing how the record control portion 108 of 
audio recorder 106 includes a watermark Wl detector 114, a 
watermark W2 detector 116, and a watermark W2 embedder 118. 
The signal output from watermark Wl detector 114 is the 
indication of watermark Wl being present at 122. This is 

25 logically combined at 124 with the indication of whether 

watermark W2 is present. Only if both watermark are present is 
switch 128 opened, thereby preventing recording; otherwise 
switch 128 is closed thereby communicating the input audio with 
the added watermarks A+W1+W2 on the output terminal 13 0 of 

30 record control portion 108. It is to be understand that Figure 
8 only shows the record control portion 108 of recorder 106, 
the remaining portions which are not illustrated being the 
conventional recording portions. 

This disclosure is illustrative and not limiting; further 

35 modifications will be apparent to one skilled in the art and 
are intended to fall within the scope of the appended claims. 
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For instance, the present system and method are readily applied 
to TV and video following various standards. 
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CLAIMS 

We claim: 

1. A method of controlling copying of a video signal, 
comprising the acts of: 

supplying the video signal; 

embedding a watermark in the video signal; and 
providing associated data in a predetermined location 
of the video signal, the associated data being related to 
the watermark in a predetermined manner. 

2. The method of Claim 1, wherein the associated . data is 
a cryptographic value. 

3. The method of Claim 2, wherein the cryptographic 
15 value is a hash function of a seed, and the watermark is the 

hash function of the hash function of the hash function of the 
seed. 

4. The method of Claim 1, wherein the predetermined 
20 location, for NTSC TV, is video line 21. 

5 . An apparatus for processing an input video signal to 
control subsequent copying thereof, comprising: 

a seed generator; 

25 a hash function generator coupled to receive a seed 

from the seed generator and output resulting data; 

a watermark generator coupled to receive the seed and 
generate a watermark from the seed, and to embed the 
watermark in a picture portion of the input video; and 

30 a transmission channel coupled to transmit the 

resulting data and the watermarked video to a receiver, 
the resulting data being transmitted other than in a 
picture portion of the video. 
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6. The apparatus of Claim 5, wherein the watermark is 
the hash function of the hash function of the hash function of 
the seed. 



5 7. A method of controlling copying of a video signal 

having an embedded watermark and associated data, comprising 
the acts of: 

determining if recording of the video is to be 
permitted; and 

10 only if recording is permitted, transmitting the 

video signal and the associated data, wherein the 
watermark has a predetermined relationship to the 
associated data. 

15 8- The method of Claim 7, wherein the associated data is 

a cryptographic value. 

9. The method of Claim 8, wherein the cryptographic 
value is a hash function of a seed, and the watermark is the 

20 hash function of the hash function of the hash function of the 
seed. 

10. The method of Claim 7, further comprising the acts 

of: 

25 deciding if the recording is to be permitted; 

reporting that recording is to be permitted; and 
charging a fee for permitting the recording. 

11. A set top box for connection to a television 
30 receiver, comprising: 

an input terminal adapted to receive a video signal 
including a watermark and to receive associated data; 

a conditional access control, having a control 
terminal for receiving a user selection for enabling 
35 recording of the video signal; and 
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a combiner having a control terminal coupled to an 
output terminal of the conditional access control and 
receiving the video signal from the input terminal, and 
having an output terminal, wherein the combiner outputs 
5 the video signal with or without the associated data in 

response to the conditional access control. 

12. The set top box of Claim 11, further comprising: 
a connection to an uplink, and wherein the 

10 conditional access control transmits to the uplink an 

indication of user selection. 

13. The set top box of Claim 11, wherein the associated 
data is a cryptographic value. 

15 

14. The set top box of Claim 11, further comprising a 
video recorder coupled to record the output video signal. 

15. A method of operating a video recorder, comprising 
20 the acts of: 

receiving an input video signal having a watermark; 
detecting the watermark; 

detecting data associated with the video signal; 

subjecting the data to a predetermined compression 
25 function; and 

allowing recording of the input video signal only if 
the detected watermark matches the result of the 
compression function. 

30 16. The method of Claim 15, wherein the compression 

function is a multiple hash function. 

17. The method of Claim 15, wherein the data is on a 
predetermined video line in the vertical blanking interval of 
35 the video signal. 
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18. The method of Claim 15, wherein the data is a 
cryptographic value. 



19. A video recorder, comprising: 
5 an interface to a recording medium; 

an input port for receiving a video signal to be 
recorded on the medium; 

a watermark detector coupled to the input port; 

a data detector coupled to the input port to detect 
10 data at a predetermined location in the video signal; and 

a processor coupled to compare the detected watermark 
to a compression function of the data, and to enable 
recording of the video signal onto the medium if the 
comparison is a match. 



15 



20. The video recorder of Claim 19, wherein the 
compression function is a hash function of a hash function of 
the data. 



20 21. The video recorder of Claim 19, wherein the data is a 

cryptographic value. 

22. A method of controlling playing of a video signal 
recorded on a medium, comprising the acts of: 
25 playing the video signal from the media; 

detecting a watermark in the video signal; 
detecting data associated with the video signal; 
subjecting the data to a compression function; and 
allowing further playing of the video signal only if 
30 the watermark matches the compression function of the 

data. 



23. The method of Claim 22, further comprising the act of 
applying an analog copy protection signal to the played video. 

35 
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24. The method of Claim 22, wherein the compression 
function is a hash function. 



25. The method of Claim 22, wherein the data is a 
5 cryptographic value. 

26. A video player comprising: 

an interface to a recording medium which outputs a 
video signal; 

10 a watermark detector coupled to receive the video 

signal; 

a data detector coupled to detect a data associated 
with the video signal; 

a processor coupled to the watermark detector and 
15 data detector and which subjects the detected data to a 

compression function and compares the watermark to the 
compressed function of the data and allows further playing 
only if the comparison is a match. 

20 27. The video player of Claim 26, wherein the compression 

function is a hash function of a hash function. 

28. The video player of Claim 26, wherein the data is a 
cryptographic value. 

25 

29. A method of controlling copying of a video or audio 
signal, comprising the acts of: 

supplying the audio or video signal; 
embedding a first watermark in the audio or video 
30 signals- 
transmitting the video or audio signal to a user; and 
embedding a second watermark in the video or audio 
signal in response to an action by the user. 



35 



30. The method of Claim 29, where the action by the user 
is an indication relating to payment. 
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31. A method of controlling copying of a video or audio 
signal having an embedded watermark, comprising the acts of: 

determining if recording of the video or audio signal 
is to be prevented; 

if recording is to be prevented, adding a second 
watermark; and 

transmitting the video or audio signal with the first 
and second watermarks. 



Of: 



Of: 



32. The method of Claim 31, further comprising the acts 



deciding if the recording is not to be prevented; 
reporting that recording is not to be prevented; and 
15 charging a fee for not preventing the recording. 



33. The method of Claim 31, further comprising the acts 



if recording is permitted, recording the audio or 
20 video signal; and 

adding to the recorded audio or video signal the 
second watermark. 



34. A set top video or audio box for connection to an 
25 associated receiver, comprising: 

an input terminal adapted to receive a video or audio 
signal; 

a conditional access control having a control 
terminal for receiving a selection enabling recording of 
30 the video or audio signal; 

a watermark embedder for embedding a second watermark 
and having a control terminal coupled to an output 
terminal of the conditional access control and receiving 
the video or audio signal from the input terminal, and 
35 having an output terminal, wherein the video or audio 

signal includes a first watermark; wherein the watermark 
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embedder outputs the video or audio signal with the first - 
and second watermarks in response to the conditional 
access control. 

35. The set top box of Claim 34, further comprising: 
a connection to an uplink or computer network, 

wherein the conditional access control transmits on the 
uplink/network an indication of the selection. 

36. A method of operating a video or audio recorder, 
comprising the acts of: 

receiving an input audio or video signal having a 
first and a second watermark; 
detecting the watermarks; 

preventing recording of the input video or audio 
signal if both the first and second watermarks are 
detected. 



10 



15 



37. A video or audio recorder, comprising: 
an interface to recording medium; 

an input port for receiving a video or audio signal 

to be recorded; 

a watermark detector coupled to the input port; and 
a processor coupled to receive an indication of 

detected watermarks, and to prevent recording of the video 

or audio signal onto the media if two predetermined 

watermarks are detected. 



38. The video or audio recorder of Claim 37, further 
30 comprising a watermark embedder operatively coupled to the 
processor. 



39. A method of controlling playing of a video or audio 
signal recorded on a medium, comprising the acts of: 

playing the video or audio signal from the medium; 
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detecting any watermarks in the video or audio 
signal; and 

preventing further playing of the video or audio 
signal if detected watermarks match respectively two 
predetermined watermarks . 

49. The method of Claim 39, further comprising the act of 
applying an analog copy protection signal to the played video 
or audio signal. 
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